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staff activity, and cos+s. The mcn^torinq process includes planning, 
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elfements, feedback, and ^he da+a processing mode (manual versus 
automated). Specific sUgqesticrs and i)ractical examples are included. 
The final section links information system reports «ith management in 
order to assist managers by providing data about program goals, 
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raoorts aid program and budge* planning and program 'evalu atian. 
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FOREWORD 



The Southern , Regional Education Board was awarded a grant (Mental Health 
Training Grant No. 1-T15-MH14703) In late 1976 from the State Manpower and 
Development Branch of the National Institute of Mental Health, The Project 
was to develop publications and conduct workshops to assist mental health 
centers in improving the^ management practices and thel^ program activities 
through the use of practical prograiv evaluation, A series' of publications ' 
and workshops ip being developed throygh the combined efforts of the Board's 
staff and task force participants. Topic areas include: 

o The Administrative Uses of Program Evaluation 

o Usfe of Information Systems for Monitoring Mental Health Programs 

o Linking Needs Assessment to Program Planning and Management 

o Quality Assurance in Mental Health Centers 

0 ^llent Outcome Evaluation in Mental Health Centers 

o Improving Staff Productivity In Mental Health Centers 

The selection of these topics was based on the preferences expressed in a 
survey of mental health centers and clinics in the 14 states served by the 
Southern Regional Education Boards ' 

The Use of Information System^ for Monitoring Mental Health Programs 
describes the monitoring process tZ examine the relationship of information 
systems to monitoring and to dlq^ss the role of monitpring in decision^ 
making in mental health centers. This publication J^s based on^th6 recommen- 
dations* of people in mental health centers and state mental health agencies. 
We thank all of them^for their willingness to share their knowledge and 
experiences with us. We assume responsibility for the content of this report 
including any misunderstandings resulting froito the translation of ideas. 
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INTRODUCTION 

An Information system yields data that are the basic building blocks for 
many clinical and managerial functions in' a mental health center. In many 
pases, mental health agencies have installed information systems to meet the 
recordkeeping and reporting requlj^eiffents of funding and accrediting agencies, 
but have not developed the full potential 'of these dafta systems for managing 
programs through systematic monitoring. The information system^, if appro- 
priately designed and used, is the means for collecting ancl compiling data, 
while. monitoring is the process used by managers to assure that the program 
is meeting its goals. 

The purpose of this publication is to describe the monitoring process, 
to examine the relationship of iaformation systems to monitoring, and to 
discuss the role' of monitoring in decision making in mental health centers. 

WHAT is MONITORING? ' 

Monitoring ^.s the process of comparing activities, and the use 

of resources with the established plans , priorities, and objectives 

.1 * * 

J* which have been' set for a program. The purpose of monitoring is to 
'identify wh^t is hapoening to clients and how resources are being 
used compared to plans. If divergence is noted, corrective .act'ion 
is taken. 



^ ■ . ■ - ■ ■ . 

Monitoring Is essential to the survival a mental health denter. In 

^ Its simplest, most rudimentary form, It may l?e little more than good house- ^ 

keeping, where data reports play a minor role. But data from Information' 

systems can b6 used to monitor and control center operations and enhance the 

efficiency and effectiveness of the management process. 

There are three^ areas of Information needs for Internal management: 
* 

1) Clinical managemeut and quality assurance ; data which assist in the' 
supervision and review of clinical interventions and^ provide feed- 
back to clinicians; , . ^ ' 

2) Program goals ;^ data about progress toward wHfet the program is 
expected to accomplish; • ' 

3) Resource control : data, about the agency's staff facilities and 
financial resources.^ 

• 

There are different sources for these threotkinds of information. This 
publication focuses on. data that can be included in Infortnatlon systems and 
used fpr monitoring, * 
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THE MONITORING PROCESS 

> — ■ • - ■ — ^ » 

• \ 

\ 

^ As sh-own in the fdllov/lng 6Hart,c^the monitoring process has three st'ages: 
planning, monitoring ahd assessment. An adequate information system based on 
the center's annual plan for programs and budgets is needed for routine mojii- 
:oring and annual assessment. ^ 

-Planning Stage 

In the planning stage the key indicators needed for monitoring are 
identified and included in the data to be collected by the information 6ystem, 
The center's annual plan for programs and budget selves as thebasis for 
selecting the data items about activities and resources to be monitored by 
managers • There are several kinds of indicators, each based on different 

4 

aspects of the annual plan. Three possible kinds of indicators are: 
o Indicators about resources 
o Indicators about program goals 
o Indicators about compliance v/ith standards 
The most basic form of monitoring focuses on the control of a center's 



resources — staff, expenditures, facilities, and supplies. Managers need 
information that calls immediate attention to any groas deviations .from ^ 
expectatioqs. Indicators^ are selected that will assist the manager in 
Identifying the use of key ijesOurces in relation to the resources allocated, 
(e.g., costs, staff time and activity). 



^ ■ * ■ 
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THE MONITpRING PROCESS 



ANNUAL PLAN FOR 
PROGRAMS AND EfllDGET 



THE> PLANNING STAGE 
DESIGNING AN INFORMATION 
SYSTEM THAT ^AN BE USED FOR 
MONITORING INCLUDES MINIMAL 
DATA ON CLIENT MOVEMENT, 
SERVICES, STAFF ACTIVITY 
AND COSTS 
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INFORMATION SYSTEM REPORTS TO: 



sy ; 

3AR1 



GOVERNING BOARDS . '■ 

ADMINISTRATION 
CLINICAL SUPERVISORS 
PLANNING AND- EVALUATION ' v i 



MODIFY PROGRAM , 
ACTIVITIES OR 
RESOURCE UTILIZATION 
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THE ASSESSMENT STAGE 
PERIODIC ASSESSMENT 
OF RESOURCE AND 
CLIENT UTILIZATION, 
GOALS AND STANDARDS 



ANNUAL PLANNING FOR 
PROGRAMS AND BUDGET, 
INCLUDING flEEDS, 
RESOURCE UTILIZATION, 
STANDARDS AND INFOR- 
MATION SYSTEM IjNPUT 



REQUEST SPECIAL 
STUDIES 

^Tv 



OTHER DATA 



PERSONNEL RECORDS . 
CLINICAL RECORDS 
it^VENTORY CbNTROL ♦ 
QUiiLITY' CONTROL AND 
ASSESSMENT REPORTS 
CONTRACTS /AGREEMENTS 
STANDARDS (INTERNAL 
' AND EXTERNAL) 
POPULATION CHARACTER- 
ISTICS OF CATCHMENT 
SPECIAL EVALUATION 
STUDIES 
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The second kind of. monitoring is used to assess the attainment of 

- - ' 

pirogram goals > The criteria are the goal statements developed in the center's 
annual plan^for servicesi Go^ls describe the desired rfesults in clients or 
changes in the community's mental health whidh the organization seeks to 
bring about. % 

There are five basic criteria for goal statements;: I) set a deadline 
for the activity; 2) name the target group; 3) state me desired outcome: 
4y set the conditions or restrictions under which the desired outcome may be 
expected to occur; and 5) specify the minimum criteria for^measurthg the 
results desired as evidence that the goals were reached,^ 

The^ indicators selected for monitgring goals are measures of results 
identified in the annual plan. Not all goals can or should be monitored on a 
continuous ba^is. In many cases, a semiannual or^ annual assessment of results 



Is adequate. Usually, only those identified a^ priorities require freq^nt 
monitoring by the program's administrator or evaluator. The indicators 
selected for monitoripg may consist of "hard" numbers, such as hours of bill- 
able services per week or the number o^. clients served, or "soft" data, such 
as turnover rates of personnel or client responses to follow-up questionnaires 
that will indicate consumer satlsf action v -> > 

Finally, standards can be used as criteria for monitoring the quality of 
the center's services. Standards (a state or condition accepted as minimal or 
exemplary, appearing in law, regulation or policy) have been developed by 
^ state, federal,and national accrediting agencies in response to the require- 
ments of third^jiarty payment programs (e.gv>. Titles XVIII and XIX under the 



Social Security Act and private insula) and legislation regarding cost, 
containment and quality assurance (e.g., Professional Standards Review 
Organizations (PL 92-603) , the Community Mental Health Centers Act (PL 94-63) . 

♦ 

and Health Systeras Agencies (PL 93-641)- / 



o Input standards describe the resources required to carry 
pr/bgrams. They Include building standards, staffing sta 
and equipment §tandards- ' ... 



out 

in§ standards, 



o Process standards specify the procedures and kinds and » amounts of - 
therapy that are appropriate for given patient groups. 

o Outcome standards measure^ the results of care provided to 'patients. 
These standards would appear to be ideal from the perspective of 
evaluating tKe q'ualitjj of patient care, but. they are difficult tc5 
use because of the diverse qature of mental health problems and 
interventions. 



The Monitoring Stage • ^ 

In this stage, managers receive^ata riBports on the indicators that are 
relevant to their particular area of res^^bility. These reports, when 
cpmpared to the expectations defined by the annual plan, call attention to 
apparent deviations. Monitoring is similar to reading th^ Dow- Jones ^ 
averages — it s.hows key trends but rarely ^^rovides all the information needed 
for final decision making. Thus, other inputs, such as special studies, 
direct observation, and personal communication, are used to put the xieviatlions 
in proper context. . ' 

The frequency of reports for monitoring depends largely on management 
style and the size aifid geographic location of the center's services. Managers 
may request weekly reports on resource indicators but may need only quarterly 
or semiannual reports to measure progress toward program goals. The 



\ 

\ 



/ 



^4 

administrator of a center with a number of satellite facilities^ will. probably ^ 
need reports more frequently than one whose services are all provided in a 

single location. * , * * . . 

^ ,* 

At times, the manager may request special reports when monltpring^ calls . 
attention to a problem that requires hiore detailed information. ""IFfee data fpr 
special reports may be^ drawn entirely from information system files ox they 
may be developed by merging data from other * sources with data accessed |'rom 

■ %'-^ ' 

the information system. , 

The Assessment Stage *^ . 



Periodically, cumulative reports which summarize and analyze program 
activities and use of resources are ^compll'ed to assess <^utcomes or resuy.ts of 
programs. These reports are used to 1) determine whether the expectations 
defined by program goals were met; 2) provide baseline Information for plan- 
nlng future program activities and budgets; 3) yield data needed for evalua- 
tion studies; and 4) provide data for external ^reporting to funders, third 
party payers, affiliated agencies, commVinlty' groups and others. After com-- 
pleting the third gtage, the monitoring process begins again. 

\ • c . 
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INFORMATION SYSTEMS AND MONITORING 



\ 



"A mental health center, must decide pn the Hpds of data that are to be ^ 
collected by its information system on a continuous basis. Centers operating 
und'er the Community Mental' Health Centers Act Amendmerit <PL 94-63) are given 
basic guidelines whicl;\^ state^quired information system capabilities: 1) a* 
statistical component that can compute information on client characteristics,, 
staff activities, and services provided; '2) an accounting component that 
compiles information on revenues and Expenditures; and 3) a way to integrate /•' 
data from these two components fop fiscal management (cost-accounting, 
rate^setting, and budgeting). Many states have established similar require- 
ments and have .implemented state\>ride reporting systems. .These requirements 
have often been the motl\^atlon fqr center managers to Install or upgrade^jap V 
information system- ^ ' ^ 

^ This publication do^s not .attempt to deal with the ^amut of Information 
system design, implementation, and use, since many publications have already 
done this. The reader is referred to the bibliography for some of these 
sources. Some of the basic principles' in the design > implementation and use 
of an Information system that make data most useful are presented here to ' 
define what is meant by the term ''practical information system.*' 
An information system is: 



A system for gathering information, accumulating data in an 
t)rgani2ed file and summarizing infortnation in periodic reports 
responsive to special requests .2 
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The purpose c^^ an in formjj^tlon' system is tojklocument- the jictivities and the 
use of resources so that timely, periodic ^reports are available to program 

and administrative personnel for. monitoring, evaluating arid planning within 

, I * . 

the center as well as reporting to' ejcternal agencies. An -information system 
is a support service witl^J|;|^ the organization and, as such, should be designed 
tt^'^be as simpl*e and practical as po8sf^)le; - 

WHAT MAKES AN INFORMATION SYSTF^ USEFUL? * ^ ^ 

* r- There are a numHet of characteristics that hel^i answer this question.' 

. * ■ 
Organizational Readiness 

Chapman^ Identifies several major aspe^cts if ^.^rganizatipnal cl^jnaVe which 

influence the. succyss of a center in implemenl:ing and using an information 

system* The readiness of the S^rganisjation to use an information : systefra re-^ 

volves around staff attitudes that are derived from strongly held values. 

o Accountability ; Does the organization recognize the need 
of an information system as a management tool? 

o Resource Utilization ; Is the organization willing to look 
at hard data to determine if the services being provided 
are effective in terms of meeting a center's objectives at * * 
a reasonable cost and to use these data to assist Iri y 
allocating resources? 

' - 1. 

^ Cost: Does the organization^ perceive the cc^t of establishing 
and ma^^ntaining an information system to be justifiable it) 
terms of Its usefulness to the organization? 

. * ' ' M " * \ • ■ 

o Patient ^ Ri g hts ! Does the organization see confidentiality 
of patient data as a barrier In establishing .an information 
system? 

o Threat to Stat >UQ ! Is the organization prepared to accept 

the reallfcy that hard data may bring agency problems ^ 
^ out into the open? / ' 



Ther.e are mahy ptos and cons on these issues. These quest ion3> can be^ 
resolved if they are dealt with by the center administrator and staff to- 
gether. None are insurmountable all h^ve to be seriously considered if the 
org^ization hopes to establish, maintain and u^e an 'information ey^tem^ 

The design of an information system actually begins with documentation 
of the functional structure of the agency which includes the |oals and 

and administrative staffing patterris, financial and 



objectives, proresslonal 



physical resources so that the data from the' information system will descri\)e 
. . . % 

the activities going on in the center in rela'tion to its structure. Several 
approaches to defining the organizational structure of a center are used: 
I) by categories of ^ designated services (ei. g .,, inpatient , outpatient); 2) by 
age groups (^.g.\ children, adults); 3) by type of disability (e.g., drug 
abuse, mental retardation) j' or 4) by a combination (e.g., age group and type 
of disability) > ^ . ^ 

User Orienta tion , 
Data reporting systems are too* of ten designed^ more' for external repqrt.-^ 
Ing purposes than for ujse .by the center's internal management. There is no 
reason why informatjion cannot be developed for use by' both external and 
internal users. A center director cannot ignore re(fuesti8 for information 
from those who finance the center, bat he should npt * design the inf ot'mation. 
system to furnish only that information.^ .v 

• ^ * ■ * ■ V . 

An information system should collect a jninimal amount of * data on a 
continuous basis. The nature of. this data can best be defined by the needs ' 
of the users of information by asking: • , ' • / 

■/ , . ( . 



1) How are the data to be U8^d7 ' ' . 

2) What format and: content will make reports most useful? 

- . . ■' ■ ^ 

\ 3) How oft^n will reports be neStded? 

Users Include supervisory personnel, program managers; administrative 
supRort personnel (planning, evaluation, fiscal, etc.)» the center.'s a'dmlnls- 
^trator, thS^^^^f^ter's board, affiliated human stervlcee agencies, local 
government ,v state and federal funding agencies, health planning organizations 
third party payers and clHzen groups.' Efforts should be made to avoid 
overestimating the mlnlmaldata needs for an information system. 

Two kinds, of reports may be requested by users: 1) regular, routine 
reporting at specific time Intervals and 2) special requests for Information. 
It is suggested that a schedule for routine reports be developed annually 
to define when reports are needed, Ehe required form and cont;ent, and the 
users. A schedule enables the persons responsible for the information 
system to plan their work and to respond to unanticipated special* requests 
for data in a more efficient, timely way rather than bel\ig faced with monthly 
shifts in reporting priorities. 

Data ^requirement 9 should be reviewed and adjusted annually to be compat- 
ibl^. with* changes in goals and objectives and the;^ organizational structure. 
One helpful way 6f cfetermlning T:he kinds of reports and dpita that are needed 
Is to maintain a register showing actual requests for data, whether the 
requests were filled and how long it took to flil them* 1/ the requests for 
data could not be filled, the reasons should be stated (e.g,, lack of 
appropriate data, l^ck of time). This register serves at least three* 
purposes: 1) it documents data usage and frequency of use; 2) it identifies 

^ 11 ^ 
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unmet data vieeds and the frequency ot: requests for t^ese data; and 3) It. 
^ monitors the ©t f ectiveneas 'of the system in serving the' needs of the center. •; 
The Information derived from such a^-eglster also suggests changes that should 

made In the Information system to make Its operation more efficient and 
effective. * 

• • . \' - 

Adequacy ♦ • 

Data collected by an Information "system on & continuous basis should meet 
the minimal .needs of the center. These data should be kept up to date and 

f 

reported at regular Intervals in readable form to personnel who use them. 

An information system can be dejal^ned to provide information about any of 

the fallowing, items: 

o The quantity of services, being provided 

o The current deployment o£ resources through the center 

o The current recipients or beneficiaries of 'services ' ^ ^ 

o Cost-accounting, rate-setting, budgeting and billing 

o The quality of services and overall programs! 

When designing^ an Information system, center staff should determine the 
minimal needs for continuous Information* Kvaltiators can then design an 
Information system that Is within the rinancial capabilities of tiie center. 
Information systems vary from One center to another because of different 
peircelved needs and uses of data, ^nd rpsources available to support the 
information system* The costs of establishing and maintaining an adequate 
Information system should not be regarded as only an additional expense for 
administrative support services. To quote Sotensent 

• 1 . 
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Few organizations are fully^ aware of thfe cofits of thWt current 
data callection and manipulat ion*^f ftorts^ nor do th^y realize / 
how many opportunities they mips* to use their Resources more 
efficiently or to augment their funds. Clinical and clerical 
st^ff spend, an inordinate amount* of time filing out forms that 
are added to the record-keeping process by a succession of 
emerging ^requirements. Secretaries and administrative assistAnts 
throughout the organization often try to maintain statistical ^ 
summaries of sorts, at considerable expenditure of their time, 
• to help their bosses respond to report demands that continue to 
arise. Then there are the many crash projects for palling together 
current and, pagt data in crimes prompted' by the demands of funding 
agencies. All these^ efforts constitute hiddeti costs of^ current 
operations that are seldom explicitly recognized or summarized as 
management,, inforn\ation systems costs. ^ 

All mental health centers need statistical and financial information for 
both external reporting and Internal management purpfises. Although these 
information components are different in their data inputs, and the responsi- 
bility for their operation is often assigned to separate brganlzatlon^J^ units 
within a center, they should he compatible with each other. The data X^nlts of 
the program component shotild include measures of activity that can be related 
to financial data for c6st-f inding , rate-settij^g and budgeting purposes^ 

The statistio^ component should include three interlocking subsyst< 



ems 



focused on I) cl 
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ent charact6ristic3, 2) staff activity, an4 3) services 
rendered, ^he/three subsystems are tied together because all deal with t^he 
same process:' "Which therapist is treating what client in what program with 
what techniques for what deration with what consequence."^ Furthermore, the 
actual data collection procedures' frequently Involve the use of the same input 
documents (e.g., service tickets, staff activity reports)/ The kinds of 
program data use4 by a center have a direct bearing on tht information's use- 
fulness for internal management. Some centers find that ^ata describing 
activities (number* of admlesions, discharges, contacts) ]^ithln designated. 



\ - 
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. programs (e.g., outpatient ,^ iapatlent) are adequate.' But most find It. ' 

desirable ^:o have information that provides more functional data about the v 

types and results of services provided (e . g ., kinds .of services, providers, 

fees, locations, client outcomes). 

Some of the data categories Included in program statistics are: 

I • 

Client In formation * • . ^ 

' T * ♦ 

o client identification 

Demographic characteristics ' 
o Residence 
6 Payment ^status 

,^ / o Initial diagnosis qr presenting problem 

* I 

o History of previous care 

* ■ 

o Treatment received 

o ConjJition at termination or discharge - 
o Disposition on termination or discharge 

. o Periodic assessment of psychological and/or social functioning 

• . ' 

Service Information * ' . ' 



o Number of clients served by service units 

o Admissions and terminations ^ 

o Client movement among services 

o Medications ^nfl other treatments 

o Length of stay ^ ♦ 

I. ' 

o Indirect services 
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Staf^f Activity Information . /V ^ , * * , • . 

o Staff hours Individ u^iii ^nd aggregated) JLn direct service by typfe of 
activity ■ \^ • -m • 

Q Staff hours In Indirect services by type of activity f ^ . 

0 Number of clients assigned to Individual staff members 

o Staff hoyrs In activity . other ^than direct and Indirect services 
(done routinely or periodically by sampling) 

The financial component an Information system uses Information on 
revenues and expenditures, payrolls, payments on other expenditures,' cost- 
accounting, and rate-setting. While the statistical component requires the 
processing of data from numerous staff members to produce reports, the 
financial component Involves r*latlvef^f ew inputs of data from selected 
etaff members. 

The financial component can Include the following information: 

o Total center costs 

o Costs by service element 

V 

r *• 

o Cost per* unit of service > 
o Cost per epis od^of care 
o Costs of specific treatment modalities 
'o Fees charged 

o Income by source of funds ^ » * 

Integration j,. 

Integration Is a bffsic Issue for Informaticf^ systems. Reports from an 
Information 'system assist managers In 'interpreting the relatlonEThlps between 
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otganizatlonal resources and' -ac tlvityj.es, .Thus the elements of an* information 
system ''are Interdependent ,* mutual ly Interactive jind are d^namtp oxfer timq iif 
tjhe role of connecting a center^s structure to its process/'" 

The influence of vai5ious elements upon each other suggests that the 
overall, infqpfhatton system should be designed at a single point in time so 
that its ^ements are integrated and appropriate. For example, data collectjed 
regarding program statistics should be organized in a way that makes it pos- 
sible to relate the infojn^gtion to financial records of individL|al service 
unit^. This makes it possible to assign costs to each organizational unit 
and establish a reasonably accurate relationship between the services provided 
and the cost of these services, Al^&o,^the design and collection procedures 
for input documents should minimize the number of forms that must be filled 
out* When ^at all possible, data inputs for the information system should be 
a by-product of other procedures (e,g., service tickets used for billings). 
It Is not always necessary or desirable that all subsystems of an information 
systjpm be Implemented simultaneously. Provided there is an overall plan for 
ai\ Integrated informatiqn system, implementing each subsystem separately may 
reduce the disruption of staff and minimize the staff time needed to get each 
subsystem operating smoothty* , » 

Feedback 

For an iinformation system to be useful for management, there must be 
feedback in the form of regular, tlme^ly reports* "Managerial staff in various 
service units need reports^ that will ^ssist them in monitoring the progress 
of activities within their area of Responsibility so that tflty are better able 
to make rational decisions about changes in operations that may b0 needed • 

16 



, Periodic progress reports' can also be helpful in providing feedback ta ^ 
goyerning boards and^ community groups so^ ^bat they are? more fully aware of the 
centl^'s activltieis'v , ^ ^ • , 

There are varied opinions about the need to provide regular feedback 
reports to all clinical staff within the center. One position holds that 
clinicians should not be held accountable unless management provides regular 
feedback to them about their activities. Sych feedback encourages staff to 
submit prompt and complete reports into the data collection process. Another 
position argues that clini^l staff should have access to the kinds of infor- 
mation that they need to enhance the^^^f f ect iveness their work. This does 
not necessarily mean that all clinical staff should have routine reports on 
service activities. It is questionable whether much .of these data would be 
useful to them. There is geaeral agreement that clinical staff, whether in 
supervisory positions or not, should be able. to request information on aspects 
of service delivery that are relevant to their work with clients. The way in^ 
which a center administrator handles this issue will depend largely on the 
attitudes of the ^clinical staff toward feedback reports, their ability to use 
them constructively, and thfe capability of the information system to produce 
large numbets of ifteports. 

It is suggested that all staff members, particularly clinical staff,, be 
full^ informed about the progres^ of planning, implementation and uses of any 
new information system and that they be encouraged to make suggestioh^ abou^ 
♦the overall process as well as to identify the kinds of reports that th^y will 
need to do their Job better. At the time of implementation it will be 



17 



ever, an ^tomated data system is not necessarily the solution to the datf 



Deceesary to educate staff member^ in tl^e procedures and uses' of Information 
syatem reports so that thtfy ^re aware of the potential^ways that information 
can be useful to theiti. ' 

I- 

Manual versus Automated Data Processing 
. Many people equate the term, "information syst£m" to "computer. "^How- ' 

:a \ 

processing needs of a mental health center. All centers have'^some form of 

information system,, although they may not^realize it. ^ The existing clinical. 

and fiscal records may be incomplete, Inadequate or cumbersome, but they can 

< ' ' - . 

be improved and made useful without the benefit of a. computer. Computers 

speed the/ferocess in g and compiling of data, but the same data collection and 

data editing procedures are required r.egar'dless of how the data is processed. 

There are several options that will allow a center to meet its needs for data 

processing at a reasonable cj^st. The^ major issue when considering alternative 

.approaches is whether the higher costs of jan automated system will be offset 

by having a more efficient system of processing data. A cost-effectiveness' ' 

study will determine ttie be^iefits of alternative approaches' of processing 

data, cort^ering development costs, operating expenses and long-range ncefl^ 

for data processing. 2 Major .constraints that must be considered arH 



budget allocation for the information system, the size of the center 



the 



's 'staff , 

• \ 
and what the * information system is expected to do- Some of the data proceeg-- 

ing options that are available to centeVs are:^ <^ 

1) Manual systems in which all information is collected and processed by 

hand. , This kind of system Is appropriate for smaller centers with relatively 



simple needs for data procesBlng, The primary exjfense of thld kind of Ipy'stem 

\ 

♦ * f * 

la the cost of cleriiral time. There are systems (e.g., McBe^, cards) that 
speed up the processi«ng of data. 



2) Machine-assisted manual system 



use ^of key punch equipment, card^-sorter 



3 enhance data processirf^ tM*ough the 
3, and desk calculators. Although the 



actual data collection process is not significantly improved, data access and 
compilation are made easier whep this equipment is used. 

3) Simple computers and accounting machines can further improve a manual 
system because they speed up the processing of inf ormatioh. 'Desk top mini- 
computers are now available that can be programmed to do comparatiye opera- 
tions. Their uses are primarily limited by the imagination of the staff, not 
by their level of sophistication in computer prograiraning. 

4) Computer service bureaus process data for several organizations for . 
a^ fee* To xise these services, a center gathers and edits its own information 
in an' agreed-upon form and then turns that information over to the service 
bureau for processing. Two types of services are available fifom computer 
serviqe bureaus: 

a) Batch processing consists of periodic si^lbmittals by the center 
of all the information it wants processed at a set time. The 
service bureau processes the information and ret'uriis it to the 
center along with output reports. This type of service is 
limited because special runs of information are not usually 
available and data processing is done only ^t set intervals. 

b) On-line processing involves having within the center one or more 
computer terminals which are connected to the service bureau's ^ 
computers. Under this system, a center can enter requests for 
data into the computer and responses come back immediately in 
the form of a printout or projection on a visuj^l screen. The 
advantage of this system is the immediate acctss and feedback 

of information and the* flexibility in the format of output 

^ ■ 
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r^^orts. But on-litve processing is much more expensiyfe * 
than b^tch p^o(/essing and proHably. is more sophisticated 
than is needed for most centers. ' 

^ , There are two kinds of^ computer service bureaus potentially available tp 
centers: 

a) Public service bureaus are available through state or county 
agencies. Departments bf Mental Health in some states now 

. provide computer processing services.' Often these services are 
available through county government, school boards, or local 
universities and colleges. Because these bureaus are fSiibsidized 
and do not operate for profit, services are at a lower price 
than private service bureaus but there may be limitations on 
when and how data may be processed. In some cases, a group of 
centers Jpintly contract for data processing with a public 
service bureau or set up their own centralized data processing 
services, 

b) Private service bureaus usually" charge more than public^service 
bureaus for essentially the same services. The issue of confi- 
dentiality of client information arises when a center is consider- 
ing having data processed by a private service bureau and 
safeguards should be observed by the center to avoid this problem* 

Centers should carefully examine the relative advantages and disadvan- 
tages-' of using computjer service bureaus for their data , processing. Centers 
may find that private service bureaus are extren^ely cQippetent in processing 
billing and accounting information hut limited in their "^ability and flexi- 
bility in processing program statistics. ^Public service bureaus may be quite 
satisfactory for stfftistical data processing but' are unsatisfactory in 
billing* Bureaus offer centers a viable option f6r automated data processing 
at a reasonable cost* It is suggested that before Contracting for their own 
data processing services centers seek advice from consultants who specialize 
in computer systems for human service agencies. 

5) Systems which involve le^singL buylTig^ computers are feasibly when 
a center is lai^ge enou,gh to Justify the costs. , Leasing equipmen^r requires a 
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smallei; initial outlay* of money than buying does and* allojws for replajceinent 



of old equipment with equipment having greater ^capabilities. In either, casa,; 
, the center should have staff members^vho are familiar with computer progra- 
ming and data processing as well as access to outside consultants. 
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USING INFORMATION SYSTEM REPORTS' 

> » 

• In a mental health center, the responsibility for services and the use 
of resources^begins at the clien^^ve^l and progresses thtough layers of 
management to the policy-making^ level . Managers at the different levels of 
the mental health center are the potential users of information system data 

for monitoring anO-^ decision making in those areas of the center's operations' 

♦ " ' 

for which they are responsible. (Managers in this context are persons who. 
supervise other people or are responsible for a particular set of administraTf 
tive functions in a mfental health center.) , . ^ 

Routine summary information reports should be distributed ' to the qenter 
administrator, the director of clinical services and the supervisors of \ 
service i4n^.ts within the center for regular* monitoring. This keeps the 
progress c^clinical activities and uses of resources before the. managers and 
provides readily available information for day-to-day decision making. , 

Hagedom, ^Beck, Neubert and Merlin^ point out that the monitoring of, routine 

f 

reports makes the manager more aware of the performance characteristics of 

the service unit avPi improves the ability to ^make decisions. The authors also 

Idejitify other beneficial side effects of continuous monitoring: 

o It makes the eupervleof more familiar and comfortable with 
quantitative aspects of the program Instead of only the 
qualitative or clinical aspects. 



o It establishes the credibility of the evaluation data base 
as a source of uAsful data about the program. 
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-v^ o It prepares pi^bgfam supervisors for a positive reception, and 
therefore ^increased likelihood of use of later special reports 
about the program in question. , ^ 

.. ^ * o It develops **lnf ormational curiosity" in managers and super- 
visors, so that they increasingly take the lnitlat:ive in 
asking for more information (or special studies^ about tfie^.r 
unit — r- and this is'^an almost certain prognostic sign for 
utilization of that requested information when it becomes 
available. * /"^ 

While the administrator needs information in aggjregate form about all the 

service units that make yp the center, supervisors of Individual service unite 

« 

require only reports that aire relevant^ to their own areas of responsibility, 

but in many cases, they need more detailed information. 

Information system reports us^ed for monitoring vary considerably in 

format and content from one center to another because of the individual 

centeV s -mandates'^ organizational structure, priorities, management styles. 

and information «ystem^ capability. It is therefore difficult to recommend 

particular types of reports for ose in monitoring. Instead, some of the 

potential uses o£ monitoring reports are dtiscribed and ard presented in the 

functional areas of clinical management, administration, policy making, and 

^ " « 

evaluation at\d planning. 



CLINICAL MANAGEMENT 

— - I I 11 I ■ ■ 0 

Progress toward program goals can 6e monitored through information' system 
reports. Clinical managers can use these reports to identify areas of cllni'- 
^ cal activity that require corrective action • 

Patterns of the use of services can be monitored to identify fluctuations 
' and trehds In' the ^demand for services that assist in the scheduling and 
allocation of staff time. 
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Staffs productivity ckn also b6 moT\itored through information syatem 
reports to aasure that there is an equitable distril^jution of work among 

clinical staff. i ' 

' ^ ' \ * • " 

A simple information" 8ys(:em can be used to select' and list; cj.ient cases 

\ 

for periodic quality aspessments 6f clinical records (Clinical records^ 
prpyide more detailed accounts-|of actual practice •) A more .sophisticated 
Information system with detailed client data can provide -Information on 

individual cases to assist in the assessment of continuity of care and com-- 

i * ' • ^ " / 

pliance to client care standards. Some centers record treatment outcomes 

directly into the information fjystem. Aggregate data on treatment outcomes 

iox particulaTj^^c^ij^ can then be clrawn ^f or. monitoring purposes afi ' 

well* ^ • 1^, - 

Often thpee responsible for the collection and editing of Input data for 
* • 

• • • 
j^ornverfclon sjrstems find that professional staff resist filling In forms be*^ 

/ causa they feel that the data is used more for center management than to , 

asalst them in delivery services \o the community. In fact they may feel 

that filling in fvrms takes time away from client services. Some suggestions 

for encouraging the reporting of data and the use of reports are:^ • 

0 Minimize the reliance on professional staff for data inputs 
by having clerical staff make most of the data entries • 

o. Reduce the overlap and redundancy of reporting by using multi-- 
purpose forms (e.g., using billing tickets da inputs into the 
'j^T^ statistical infqrmation system as well 'as for billing and 

accounting) . ^ . ^ ' ! 

' 0 Provide feedback reports that translate data Into usable, 
relevant Information for clinical program management. 

* ft ' V 
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ADMINISTRATION ., " ' • 

'Administrators have sevetal management responsibilities: 1) developing 

■ ■ V 

plana for programs and budgets j;^ 2) organizing and managing programS| 
3) controlling repources; and 4)- providing information to center staff, the 
go>rerning board and varied groups and agencies outside the center. The 
infonriation sys^bHu provides the dat^ needed to. carry out these responsibili- 
ties if they *are continuously ^reported , and are analyzed and summarized to 
assist- in decision making. 

Usually the center administrator requires less detailed reports thap 
supervisors. He/she ma^ delegate responsibility for monitoring details of the 
reports to administrative support service staff (e.g., the evaluator, the 
business manager, an adminiatrative assistant), expecting that these individ- 
uals will advise him/h^r on* any significant discrepancies or trends that 
require attention. The important point irf that someone . must be responsible 
for monitoring rfeports, pa4?ticularly those related to resource managemetit , to 
identify deviations from plans that require action by the administrator. 

Monitoring reports also may be used for reporting.to other agencies, 

groups and Individuals outside the center. 

o Public information and education reports for the news media, 
^ local' government , interest groups, affiliated human service 

agencies an^ individuals in the community often use data drawn 

from the monitoring reports. » 

o Regular repoifts on services, costs and clients made to local 
agerTcles that support the center are drawn directly from 
reports used in monitoring. Similarly, reports of this kind 
are required by federal and state funding agencies and some*- 
times by regional and local health planning agencies* 

o Data from monitoring reports can be used in crisis 'situations 
^ when the center is under criticism for its management or fiscal 
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practices* ttowever, adequate monitoring and declsloh making 
should correct such problem>s before they reach crlsljs dimensions, 

o Informal t ton Hyatem data and reports are also useful ^for developing 
grant appllcatlonn or requests for funds. 

Policy Makln{^ . ^ ' 

** 

The major role of governing bpards Is setting policies and planning for 
the center's operations. Frequently It; appears that board members' priipary 
Interest Is In the fiscal operations of a center. However, their interest in 
meeting cfommunlty needs can be encouraged by reports about the kinds of 
clients served and the types of service provided. Monthly or quarterly 
progress reports that show the patterns of use of services help in keeping 
board members Informed, and are a kind of monitoring. These Reports also 
enhance the board's participation aod understanding of programmatic issues 
and problems facing the center. 

Overall the purposes of providing regular reports to governing boards 
are to assist them in: 1) understanding center operations so that they can' 
make better decisions on priorities and policy; 2) understanding and respond-^ 
ing to anticipated political problems and legislative changes that affect 
programs and%policies; and 3) answering questions about programs that are 
« asked by the .community, . ^ ' " *^ 

Planning 

\ 

Summary reports on the use of services by clients assist in projecting 
future demands for services. 'Some needs assessment approaches are based on 
these data (e.g., patt^erns of use, social itidicators and rates under treat- 
rnent).* Reports about the usee of rasoUrcee and cost summaries aid in the 

26 " , 



If 

assignment and allocation o.f staff, space, and equipment. \ They also assist 
In decisions about budgets, productivity goals, ^nd fee schedules. ' 

Evaluation Monitoring ^ 

The data reports yielded from the Information system may be monitored • 
directly by managers (e.g., clinical directors and supervisors, business ^ 
managers). This, too. Is a type of process evaluation. However, one person 
should be responsible for monitoring the center's overall operations In a 
systematic way to determine whether client movement, the use of stgf and 
costs ^re falling within a rang^That Is congruent with the goals and alloca- 
tion of resources. The evaluator may be assigned responsibility for this 

overall evaluation function, reporting significant except;ions to the t:enter 

< ' J, 

administrator for corrective action. . 

OccaiBlonally a manager notas variations in the monitoring reports that 

T \ 

require Immediate action or further -^epecial study. The itature of special 
Studies varies and may involve the compilation 6i available data or^ time- 
limited collection and analysis of nev data that is not routinely kept in the 
Information system. The eval^uator is usually responsible for carrying \)ut 
special studies which require sephisticated evaluation methods. / 
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■ ' SUMMARY - . 



An information- system, if appropriately designed and used, is the means 
for collecting. and compiling data, while monitoring is the process used by 

managers in mental' health centers to assure that a program is meeting its 

^' ' ' . . 

goals. The monitc«:ing process includes planning, monitoring, and assessment 

Stages. 

The .planning stage Involves linking the center's annual plan for t)rograijis 
and budgets to the minimal data on client movement, services ren4ered, staff 
activity and costs thaf are usually included in ^he statistical and coii 
comporient8 of an information system. These dataware used by managers as key 
indicators to monitor program activities and the ,use of resources. 

Several characteristics should be present if at) information system is to 
be^useful for internal management. The staff in thje center should be willing 
to establish, and maintain a workable system that is designed to meet the data 
needs of n^nagers. The system should also be designed so that data from the 
cost aAd program statistics components can be^ integrated. Finally, the system 

should be ible to produce timely reports to the users of information. There 

^ ... * 

^re a number of alternatives bst^rocessing* information system data. Sophisti- 
cated computers are not necessarily the beat solution to a center's needs. 

Managers at different levels in the ce'nter need routine reports that^are 
relevant to their own area of responsibility. These reports assist In 

monitoring ^nd malting decisions about program activities anA the use of 

/ 



resources. Information system reports can be used by clinical managers to 
monitor progress toward program goafs, fluctuations in the demands for 
TBcrvices, and staff prodyctivity . RefportB can also be used to select cases 
for quality as.sessmei^ts* Administrators use information system reports to 
monitor program operations and provide information to governfnfe boards. 
Summary reports are uded to plan for programs hnd budgets, and evaluate 
programs. 
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